Managing resource dependent workflows

ABSTRACT

Systems and method for the management of resource dependent workflows are provided. One or more resource control devices monitor usage of a computing resource by server computing devices. Each resource control device may direct a server computing device to proceed with a workflow or to pause processing a workflow. A resource control device may further direct a server computing device to take resource conserving actions. When a computing resource is determined to be available, a resource control device may direct a paused server computing device to resume a workflow.

BACKGROUND

Generally described, computing devices utilize a communication network,or a series of communication networks, to exchange data. Companies andorganizations operate computer networks that interconnect a number ofcomputing devices to support operations or provide services to thirdparties. The computing systems can be located in a single geographiclocation or located in multiple, distinct geographic locations (e.g.,interconnected via private or public communication networks).Specifically, data centers or data processing centers, herein generallyreferred to as a “data center,” may include a number of interconnectedcomputing systems to provide computing resources to users of the datacenter. The data centers may be private data centers operated on behalfof an organization or public data centers operated on behalf, or for thebenefit of, the general public.

Computing systems within a data center may process workflows in order toperform various tasks or functions. Processing of these workflows mayrequire access to computing resource either within or outside of thedata center. In some instances, these computing resources may belimited, such that they may only be accessed by a limited number ofcomputing systems at any given point in time.

BRIEF DESCRIPTION OF THE DRAWINGS

The foregoing aspects and many of the attendant advantages of thisdisclosure will become more readily appreciated as the same becomebetter understood by reference to the following detailed description,when taken in conjunction with the accompanying drawings, wherein:

FIG. 1 is a block diagram illustrating an embodiment of a workflow grouphaving server computing devices, a workflow control device, resourcecontrol devices, proxy control devices, and computing resources;

FIGS. 2A-2C are simplified block diagrams of the workflow group of FIG.1 illustrating the management of a resource-dependent workflow executedby server computing devices;

FIG. 3 is a flow-diagram illustrating a workflow processing routine foran individual server computing device of FIG. 1;

FIG. 4 is a flow-diagram illustrating a resource-dependent workflowmanagement routine for a resource control device FIG. 1;

FIG. 5 is a block diagram illustrating an multiple workflow groups ofFIG. 1 in association with a workflow group oversight device; and

FIG. 6 is a flow-diagram illustrating a multiple group workflowmanagement routine for one or more workflow control devices of FIG. 5.

DETAILED DESCRIPTION

Generally described, aspects of the present disclosure relate to themanagement of resource-dependent workflows. Specifically, systems andmethods are disclosed which facilitate management of computing devicesprocessing workflows that are dependent on limited computing resources.In one aspect, each computing resource is associated with a resourcecontrol device. Each resource control device monitors use of thecomputing resource, and determines whether the computing resource isavailable for use. When a server computing resource processes a workflowor a stage of a workflow that requires access to a computing resource,it may request access to the computing resource from an associatedresource control device. Based on monitored use of the computingresource, the resource control device may grant access to the computingresource, or may direct the server computing device to pause or delayprocessing of the workflow or workflow stage. In some embodiments, theresource control device may instruct the server computing device to takea responsive action, such as disabling functionality of the servercomputing device in order to reduce power consumption, or entering intoa defined processing state.

In some embodiments, multiple workflow processing states may be definedwhich correspond to various responsive actions. For example, a firstworkflow processing state may be associated with accessing the computingresource and continuing to process a workflow or workflow stage. Asecond workflow processing state may be associated with halting ortemporarily halting processing of the workflow or workflow stage. Athird workflow processing state may be associated with halting ortemporarily halting the workflow or workflow stage and reducing thefunctionality or power consumption of the computing device. A fourthworkflow processing state may be associated with powering down thecomputing device. One or more of the above workflow processing statesmay further be associated with repeatedly sending a status indicator toa resource control device. For example, if a server computing device isinstructed to halt processing of a workflow state, it may further beinstructed to send periodic status updates to the computing resourcecontroller indicating that it is waiting on access to a computingresource. In some embodiments, the computing resource controller isconfigured to grant access to the computing resource to the servercomputing device after the computing resource becomes available.

In some embodiments, computing resources may further be associated withproxy control devices. Illustratively, if multiple server computingdevices are requesting access to a computing resource from acorresponding resource control device or transmitting status updates tothat resource control device, the resource control device may not beable to respond to each server computing device. In these embodiments, aproxy control device may be configured to receive requests to access acomputing resource, or to receive status updates, and to forward thoseupdates to the resource control device. Such proxy control devices maybe beneficial in situations where a resource control device cannot bereached, since they may allow a server computing resource to stopattempting to communicate directly with the resource control device. Forexample, such attempted communication may itself contribute tooverloading the resource control device. In some embodiments, a servercomputing device may attempt to contact a proxy control device after athreshold number of attempts to contact a resource control device fail.In other embodiments, communication may be attempted to a proxy controldevice after a specified period of time without a response from aresource control device. In still more embodiments, server computingdevices may attempt to contact a proxy control device first, and onlycontact a resource control device directly if such attempts fail.

A server computing device may be configured to interact with a resourcecontrol device through a variety of implementations. For example,software executed by the server computing device may be configured toprocess workflows by interaction with resource control devices. Suchsoftware may correspond, by way of non-limiting example, to an operatingsystem or an application executing on a server control device. In otherimplementations, hardware of a server computing device may be modifiedin order to process workflows via interaction with resource controldevices.

In some embodiments, software for processing resource-dependentworkflows may be placed on a storage device of a server computingdevice, and the server computing device may be configured to executethis software on start up. In some embodiments, this storage device maycorrespond to permanent or semi-permanent storage integrated within theserver computing device, or to network accessible storage. In otherembodiments, this storage may correspond to removable or temporarystorage, such as a universal serial bus (USB) connected storage device.Illustratively, a USB storage device may be connected to a servercomputing device during an initial boot process. The server computingdevice may be configured to load the software included on the USBstorage device. This software, in turn, may direct the server computingdevice to contact a workflow control device to request a workflow, andthereafter to process the workflow by interaction with resource controldevices. In addition, the software may be configured to allow the servercomputing device to discover available workflow control devices andresource control devices.

In other embodiments, software for processing resource-dependentworkflows may be obtained and executed by a server computing devicethrough use of a preboot execution environment (PXE). Routines,processes, and implementations of a PXE are well known in the art andwill therefore not be discussed in detail herein. Generally, a PXEallows a computing device to request boot information via a networkinterface, independent of locally attached storage devices. Using a PXEboot process, a server computing device may request software which isconfigured to request a workflow from a workflow control device andprocess that workflow by interaction with resource control devices. Asnoted above, the software may be further enable the server computingdevice to discover appropriate or available workflow control devices andresource control devices.

In still more embodiments, the hardware or firmware of a servercomputing device may be configured to discover workflow control devicesand resource control devices, and to process workflows by interactionwith these devices. For example, a network interface which wouldnormally execute a general PXE boot routine may be modified in order toinclude software for processing workflows via interaction with workflowcontrol devices and resource control devices. Illustratively, suchsoftware could be placed into read only memory (ROM) of a networkinterface or a PXE device. In some embodiments, other hardware,firmware, or ROM of a server computing device may be modified in orderto contain appropriate software or instructions.

In some embodiments, workflow control devices or resource controldevices may be configured to receive information regarding servercomputing devices without requiring modification of the server computingdevices. For example, server computing devices may be configured to usedynamic host configuration protocol (DHCP) in order to obtain aninternet protocol (IP) address on boot. The DHCP server device may be incommunication with a workflow control device, a resource control device,or both. After receiving a DHCP request from a server computing device,the DHCP server may alert workflow control devices and resource controldevices that the server computing device will soon be requesting aworkflow. In these embodiments, either or both of the workflow controldevices or the resource control devices may prepare to receive suchrequests. For example, when it is expected that a server computingdevice will request a certain computing resource, the resource controldevice may begin to make that computing resource available for use.

In some embodiments, the server computing device may be configured tointeract with a resource control device at various times during aninitialization process (sometimes referred to herein as a “boot” or“boot up” process). For example, where software for implementingresource-dependent workflows is embedded in a ROM of a computing device,the device may be programmed to process workflows during a very earlystage of a boot process, such as when loading instructions to implementa PXE boot. Where such software is contained on a data store, such as aPXE server or a USB data store, the computing device may implementsoftware for processing resource dependent workflows at any pointsubsequent to receiving the software from the data store, such as priorto loading the final operating system of the computing device. Further,a computing device may be configured to process resource dependentworkflows according to the present disclosure during initialization of anetwork device, such as in response to a DHCP request. As will beappreciated by one skilled in the art, implementation of resourcedependent workflows may occur at any point during initialization orafter a computing device has initialized.

As described above, in some instances, a computing resource may not beavailable when required by a server computing device. In such instances,a server computing device may be instructed to pause or delay processinga workflow or workflow stage. In some embodiments, a server computingdevice may be further configured to repeatedly transmit a statusindicator to a resource control device. For example, the statusindicator may reflect that the server computing device is waiting on aspecific computing resource, or that the server computing device hastaken other responsive actions (e.g., reducing functionality or powerconsumption). Various mechanisms may be used to transmit such statusindicators. In one embodiment, server computing devices may transmitInternet Control Message Protocol (ICMP) echo request packets to aresource control device as a status indicator. Transmission of suchpackets, also known as “pinging”, may be used to indicate that theserver computing device is awaiting access to a computing resourcecorresponding to the resource control device.

In some embodiments, resource control devices or workflow controldevices may be configured to record computing resource access historyand timing or metrics associated with computing resource access. Forexample, resource control devices may record the number, type, oridentity of server computing devices requesting access to a computingresource and the response time and availability of a computing resourceunder various historical conditions. A workflow control device mayrecord the number of computing devices processing a workflow or workflowstage, the types or resources those workflows are dependent on, and thetiming or success rate of these workflows or stages. This historicaldata may be used in order to more efficiently manage resourceavailability or process workflows. For example, historical data mayindicate the capacity of a computing resource control under variousconditions, or the amount of capacity of a computing resource requiredin order to process a particular workflow or workflow stage.

Though described above with reference to an individual workflow groupabove, in some embodiments, multiple workflow groups may be incommunication and interact to manage workflows. For example, a resourcecontrol device from a first group A may determine that a computingresource X is overloaded or in danger of becoming overloaded. A secondgroup B may include similar computing resources which could be accessedby server computing devices of group A in order to reduce the load onthe computing resource X. As such, the server computing devices of groupA may request access to the resources of group B. In this manner,multiple workflow groups may interact to manage workflows across thesegroups. In some embodiments, multiple workflow groups may be configuredto collectively decide mitigating actions to take when one or moreworkflow groups require access to resources from other workflow groups.For instance, resource control devices from multiple workflow groups mayimplement distributed decision-making techniques to propose andimplement mitigation techniques. For example, resource control devicesfrom various workflow groups which manage interchangeable computingresources may form a resource “council” corresponding to that computingresource. When a computing resource from a first group is in danger ofbeing overloaded, the corresponding resource control device may proposeto the council that other computing resources from other groups be usedto offset the load of the first group. Collectively, the council maydecide whether to allow offloading of the load, and to which computingresource the load should be transferred. In some embodiments, a humanoperator may be required to confirm such decisions before they areimplemented.

In some embodiments, workflow groups may correspond to regions in whichthe workflow groups are located. For example, a first workflow group maybe located in a first city, while a second workflow group may be locatedin a second city. In general, each workflow group may be autonomous, andbe able to function without requiring interaction with other workflowgroups. However, interaction with workflow groups may be beneficial insituations where an unexpected or infrequent event occurs that islocalized to a single workflow group, such as a power outage or naturaldisaster.

Specific embodiments and example applications of the present disclosurewill now be described with reference to the drawings. These embodimentsand example applications are intended to illustrate, and not limit, thepresent disclosure.

FIG. 1 is a block diagram illustrating an embodiment of a workflow groupenvironment 100 including multiple server computing devices 106 incommunication with a workflow control device 102 and a number ofcomputing resources 130 via a network 104. Illustratively, a workflowgroup may include any number N of computing resources 130. As shown inFIG. 1, this illustrative workflow group contains computing resources130A-130N. Each computing resource 130 may be associated with a resourcecontrol device of resource control devices 110 and a proxy controldevice of proxy control devices 120. In this illustrative embodiment,computing resource 130A is associated with resource control device 110Aand proxy control device 120A; computing resource 130B is associatedwith resource control device 110B and proxy control device 120B; etcetera.

Each of the server computing devices 106, the workflow control device102, the resource control devices 110, the proxy control devices 120,and the computing resources 130 may be in communication over a network104. Those skilled in the art will appreciate that the network 104 maybe any wired network, wireless network or combination thereof. Inaddition, the network 104 may be a personal area network, local areanetwork, wide area network, cable network, satellite network, cellulartelephone network, or combination thereof. Protocols and components forcommunicating via any of the other aforementioned types of communicationnetworks are well known to those skilled in the art of computercommunications and thus, need not be described in more detail herein.

The workflow control device 102 may be configured to transmit workflowsincluding one or more workflow stages to a server computing device 106,which may be configured to process the workflow. For example, a workflowmay correspond to executing a task or routine, such as booting theserver computing device, loading an application on the server computingdevice, processing data on the server computing device, or transmittingdata to or from the server computing device. Illustratively, workflowstages within a workflow may be associated with access to a computingresource 130.

A computing resource 130 may correspond to any resource used to processa stage within a workflow. By way of non-limiting example, a computingresource may correspond to network accessible storage, to a databaseserver, or to a web server. For example, where a workflow corresponds tobooting the server computing device 106, a stage within the workflow mayrequire access to a computing resource 130 corresponding to a networkaccessible storage device. This storage device may contain, for example,an operating system or portion of an operating system, applications,updates, device drivers, or other data.

In this illustrative embodiment, in order to access a computing resource130, a server computing device 106 may request access from theassociated resource control device 110. Illustratively, a servercomputing device 106 may be configured to interact with resource controldevices 110 through a variety of mechanisms. As described above, in someembodiments, software for processing workflows via resource controldevices 110 may be received via used of a PXE boot process. For example,such software could be contained within a software image obtainedthrough a network interface of the server computing device. In someembodiments, use of a PXE boot process may include transferring of suchsoftware via trivial file transfer protocol. In some embodiments,software configuring a server computing device 106 to process workflowsmay be contained within storage attached either locally or remotely tothe server computing device 106. By way of non-limiting example, suchsoftware may be contained within an USB storage drive attached to theserver computing device, or contained within network accessible storage.In still more embodiments, instructions for processing a workflow may beincluded in hardware or firmware of the server computing device, such asin ROM. Illustratively, such ROM may be included in a network interfaceof the server computing device, in the basic input output system (BIOS)of the server computing device, in PXE implementation hardware, or inany other persistent memory of the server computing device 106. As usedherein, a ROM may refer to any of a collection of computer storagemedia, including but not limited to programmable read-only memory(PROM), erasable programmable read-only memory (EPROM), and electricallyerasable programmable read-only memory (EEPROM). Subsequent toconfiguring a server computing device 106 to process a workflow, theserver computing device 106 may request access to a computing resource130 from a resource control device 110.

The resource control device 110 is configured to monitor use of thecomputing resource 130, and determine whether access to the computingresource 130 should be granted to the computing device 106.Illustratively, access to a computing resource 130 may be denied whenthe computing resource 130 is already being used by a large number ofother server computing devices 106. For example, where a computingresource 130 is able to serve ten simultaneous server computing devices106, and an eleventh server computing device 106 requests access to thecomputing resource 130, the associated resource control device 110 maydeny access to the computing resource 130. A number of metrics may beused by the resource control device 110 in order to determine whether acomputing resource 130 is able to service an additional server computingdevice 106. By way of non-limiting example, the resource control device110 may monitor the number of server computing device 106 accessing acomputing resource 130, the network use or availability of the computingresource 130, the processing use or availability of the computingresource 130, volatile or non-volatile storage use or availability ofthe computing resource 130, or response time of the computing resource130. Determination of the availability of a computing resource 130 willbe discussed in more detail below.

If access to a computing resource 130 is granted to a server computingdevice 106 by an associated resource control device 110, the servercomputing device 106 may continue to process the workflow or workflowstage. However, if a computing resource 130 is not available, theresource control device 110 may instruct the server computing device 106to halt processing of the workflow stage. In some embodiments, theserver computing device 106 may further instruct the server computingdevice 106 to later transmit a status identifier to the resource controldevice 110, or to repeatedly transmit such a status identifier. By wayof non-limiting example, such a status identifier may correspond to anICMP echo request. One illustrative routine for processing a workflowstage that may be implemented by a server computing device will bedescribed in more detail with reference to FIG. 3, below.

The illustrative environment of FIG. 1 may further include a number ofproxy control devices 120, each of which may correspond to one or moreresource control devices 110. Each proxy control device 120 may beconfigured to forward requests to access computing resource 130 that arereceived from server computing devices 106 to a corresponding resourcecontrol device 110. Illustratively, a server computing device 106 may beconfigured to transmit requests to a proxy control device 120 aftermultiple requests to a resource control device 110 have failed or beenlost. In some embodiments, a server computing device 106 may beconfigured to transmit access requests to a proxy control device 120before transmitting such requests to a resource control device. Oneillustrative interaction with a proxy control device 120 will bedescribed in more detail with respect to FIG. 2B, below.

With reference now to FIGS. 2A-2C, simplified block diagrams are shownillustrating the processing of a resource-dependent workflow by a servercomputing device 106 of FIG. 1. Specifically, FIG. 2A illustrates aninteraction in which access to a computing resource 130A is granted by aresource control device 110A. FIG. 2B illustrates an interaction similarto that illustrated in FIG. 2A, in which communication with a resourcecontrol device 130A occurs via a proxy control device 120A. FIG. 2Cillustrates an interaction in which access to a computing resource 130Ais not granted, and a server computing device 106 transmits a statusidentifier to the resource control device 110A indicating that is itawaiting access the computing resource 130A.

As shown in FIG. 2A, a server computing device 106 requests a workflowfrom a workflow control device 102. As described above, such a requestmay be facilitated by software included on a storage device, such as aUSB storage device, retrieved via a PXE boot process, or included on ROMof the server computing device 106. Further, as described above, in someembodiments a request for a workflow may correspond to a DHCP request bythe server computing device 106. For example, the server computingdevice 106 may, instead of being configured to explicitly request aworkflow, be configured to request a DHCP address on initialization of anetwork interface. The corresponding DHCP server (not shown) may informa workflow control device 102 that the server computing device 106 isready to receive a workflow. As such, the workflow control device 102may return a workflow to the server computing device 106. In someembodiments, the DHCP server may be implemented by the workflow controldevice 102. In some embodiments, a DHCP request may be transmittedduring a PXE boot process. In other embodiments, a DHCP request may betransmitted from within an operating system.

In some embodiments, a DHCP request may include informationcorresponding to the server computing device 106, such as a media accesscontrol address of the server computing device 106. The workflow controldevice 102 may utilize this information to determine a workflow totransmit to the server computing device 106. For example, the workflowcontrol device 102 may interact with a server computing deviceinformation data store (not shown) to determine other informationregarding the server computing device 106, such as the hardware orsoftware configuration of the server computing device 106 or thelocation of the server computing device 106. This information may beused to determine a workflow to assign to the server computing device106. In some embodiments, the workflow control device 106 may furtherdetermine computing resources or software that may be required during atransmitted workflow process. In such embodiments, the workflow controldevice 106 may, alone or in conjunction with resource control devices110, provision these computing resources or software such that they areavailable to the server computing device during the workflow process.For example, a workflow control device 106 may determine that, during aworkflow process, a server computing device 106 will require access to acertain device driver within a software image. If such a software imageis not yet available, the workflow control device may cause creation ofsuch a software image prior to instructing the server computing device106 to process the determined workflow.

After having received a workflow, the server computing device 106 mayprocess the received workflow in order to determine a workflow stage toprocess. Illustratively, a workflow may comprise multiple workflowstages. One or more of the workflow stages may depend on other workflowstages having been previous completed, or may require a second workflowstage to be simultaneously processed. Based on analysis of the workflow,the server computing device 106 may select a first workflow stage toprocess. Though described herein with reference to the server computingdevice 106, in some embodiments, a workflow stage may be determined bythe workflow control device 102 and transmitted to the server computingdevice 102. In such embodiments, the server computing device 102 may notbe required to have knowledge of the complete workflow. In otherembodiments, workflow stages may be determined at least partially by theresource control device 110A. For example, after completing a workflowstage by interacting with a resource control device 110A, the resourcecontrol device 110A may transmit a subsequent workflow stage to theserver computing device 106.

After determining a workflow stage to process, the server computingdevice 106 may request access to a computing resource 130A required bythe workflow stage. Though described herein with reference to a singlecomputing resource, in some embodiments, a workflow stage may bedependent on multiple computing resources. In order to request access tothe computing resource 130A, the server computing device 106 may contacta corresponding resource control device 110A. In some embodiments, thelocation of the resource control device 110A may be determined bycommunication with the computing resource 130A, with the workflowcontrol device 102, or by broadcasting a request to locate the resourcecontrol device 110A.

In response to a request to access computing resource 130A, the resourcecontrol device 110A may determine an availability of the computingresource 130A. As described above, such availability may be determinedaccording to a variety of metrics. By way of non-limiting example, suchmetrics may correspond to the number of server computing devices 106 orother devices accessing the computing resource 130A, the availablenetwork bandwidth on computing resource 130A, the available randomaccess or persistent memory on computing resource 130A, an availableprocessing power of computing resource 130A, the success rate ofinteractions with the computing resource 130A (e.g., successfultransmissions or interactions). In some embodiments, the resourcecontrol device 110A may further base availability of a computingresource 130A on expected future usage of any of the above metrics.Future use may be predicted based, for example, on the status ofworkflows being processed by other server computing devices 106. Instill more embodiments, the availability of a computing resource 130Amay reflect the stability of any of the above metrics. For example, theavailability of a computing resource 130 may be determined such that thepower use of the computing resource 130 remains near constant. In someembodiments, the availability of the computing resource 130A may furtherdepend on an expected use of the computing resource 130A by the servercomputing device 106. Determination of availability of a computingresource will be described in more detail with respect to FIG. 4, below.

As described above, in some embodiments, the workflow control device 102and the resource control device 110A may be configured to record dataregarding use of a computing resource 130A. If such history has beenrecorded previously, the resource control device 110A may use thishistory to determine an expected future availability of the computingresource 130A and an expected use of the computing resource 130A by theserver computing device 106. In addition, the resource control device110A may record the received request, as well as any determination as tothe availability of the computing resource 130A.

If the resource control device 110A determines that the computingresource 130A is available for use by the requesting server computingdevice 106, the resource control device 110A may return an indication tothe server computing device 106 that access to the computing resource130A is granted. Thereafter, the server computing device 106 may accessthe computing resource 130A in order to process the current workflowstage.

With reference to FIG. 2B, in a manner similar to FIG. 2A, anillustration is shown depicting processing of a resource-dependentworkflow by a server computing device 106 of FIG. 1. As described abovewith reference to FIG. 2A, the server computing device 106 may request aworkflow from the workflow control device 102, which in turn may returna workflow. The server computing device 106 may then determine aworkflow stage to process, and request access to a correspondingcomputing resource from the resource control device 110A.

In the illustration as depicted in FIG. 2B, however, the resourcecontrol device 110A may not immediately return an indication of whetheraccess to the computing resource 130A is granted. In this illustrativeexample, the server computing device 106 is configured, after receivingno response to a request to a resource control device 110A, to redirectrequests to a proxy control device 120A. Such redirection may occur, forexample, after a threshold number of requests to a resource controldevice 110A receive no reply, or after a time period elapses in which noresponse is received. As described above, redirection of requests to aproxy control device 120A may be beneficial in situations where requeststo a resource control device 110A are themselves contributing tooverloading a resource control device 110A.

After receiving a request to access computing resource 130A, the proxycontrol device 120A may retransmit that request to resource controldevice 110A. In order to prevent such requests from overloading theresource control device 110A, the proxy control device 120A may beconfigured to retransmit requests less frequently than a servercomputing device 106. In some embodiments, the proxy control device 120Amay aggregate requests from multiple server computing devices 106 inorder to forward one aggregate request to the resource control device110A. Such an aggregate request may specify each server computing device106 requesting access to the computing resource 130. In someembodiments, the proxy control device 120A may be given preferentialtreatment by the resource control device 110A. For example, requestsfrom the proxy control device 120A may be prioritized by a resourcecontrol device 110A over requests received from server computing devices106.

After successfully receiving a request to access a computing resourcefrom the server computing device 106 via the proxy control device 120A,the resource control device 110A may determine an availability of thecomputing resource 130A in a manner similar to that discussed withrespect to FIG. 2A, above. In this illustrative embodiment, the resourcecontrol device 110A may determine that access to the computing resource130A should be granted. As such, an indication that access is granted istransmitted to the server computing device 106, which may thereafteraccess the computing resource 130A.

With reference to FIG. 2C, in a manner similar to FIGS. 2A and 2B, anillustration is shown depicting processing of a resource-dependentworkflow by a server computing device 106 of FIG. 1. As described abovewith reference to FIG. 2A, the server computing device 106 may request aworkflow from the workflow control device 102, which in turn may returna workflow. The server computing device 106 may then determine aworkflow stage to process, and request access to a correspondingcomputing resource from the resource control device 110A. Subsequently,the resource control device 110A may determine an availability of thecomputing resource 130A in order to determine whether to grant access tothe computing resource 130A, as described above in FIG. 2A.

As shown in FIG. 2C, in this illustrative embodiment, the resourcecontrol device 110A may determine that the server computing device 106should not access the computing resource 130A. As such, the resourcecontrol device 110A may issue a command indicating that the servercomputing device should halt, at least temporarily, processing of theworkflow stage. The server computing device 106 may, in turn, executethe received halt command.

In some embodiments, the halt command may include instructions to takeone or more responsive actions. By way of non-limiting example, theseresponsive actions may include reducing or disabling functionality ofthe server computing device 106 in order to reduce power consumption.Further, as shown in FIG. 2C, a responsive action may includetransmitting a status identified from the server computing device 106 tothe resource control device 110A. In some embodiments, these statusidentifiers may be repeatedly transmitting, such that the resourcecontrol device 110A maintains an awareness of the status of the servercomputing device 106. These status identifiers may include suchinformation as the identity of the server computing device 106 (e.g., amedia access control address or an IP address), the status of a workflowbeing processed by the server computing device, the computing resource130A required by that workflow process, or any other status information.In some embodiments, a status identifier may include less that the aboveinformation. For example, a ping transmitted from the server computingdevice 106 to the resource control device 110A may constitute a statusidentifier. Illustratively, the ping may signify that the servercomputing device 106 is awaiting access to the computing resource 130A.

As described above, in some embodiments, management of workflowprocesses may be facilitated by defining states of server computingdevices 106. For example, an “invalid” state may signify a servercomputing device 106 that has not yet received a workflow. A “running”state may signify a server computing device 106 that is processing aworkflow or workflow stage. A “pending” state may signify a servercomputing device 106 that is awaiting access to a computing resource130A. This pending state may be associated with retransmitting a statusidentifier to the resource control device repeatedly over a period oftime. A “parking” state may signify a server computing device 106 thatis awaiting access to a computing resource 130A, repeatedly transmittinga status identifier, and that has reduced consumption of resources byreducing or disabling functionality of the server computing device 106at least partially. A “dormant” state may signify a server computingdevice 106 that has powered off. In some embodiments, a server computingdevice 106 entering into a dormant state may be configured to notify theresource control device 110A, such that the resource control device 110Amay cause the server computing device 106 to start when the computingresource 130A becomes available. Illustratively, the server computingdevice 106 may be configured to enter any of the above states based onspecified criteria. In some embodiments, a halt command issued by theresource control device 110A may correspond to a command to enter one ofthe above states.

With reference now to FIG. 3, an illustrative flow-diagram depicting aroutine 300 for processing a workflow of a server computing device isdepicted. This routine may be carried out by, for example, a servercomputing device 106 of FIG. 1. At block 302, the server computingdevice 106 receives a workflow process. Such a workflow process may bereceived, for instance, from a workflow control device 102 of FIG. 1. Atblock 303, the server computing device 106 may determine a workflowstage of the received workflow process to execute. Such a determinationmay be based, for instance, on the dependencies of other workflow stageswithin the received workflow process. In other embodiments,determination of a workflow stage may be dependent on the computingresources 130 that are available or will be available for processing. Insuch embodiments, the server computing device 106 may be configured toquery multiple resource control devices 110 in order to determine theavailability of resources. As described above, in some embodiments, theworkflow stage may be specified by a workflow control device 102, or bya resource control device 110. In such embodiments, block 303 may beomitted.

At block 304, the server computing device 106 may determine theresources necessary in order to process the determined workflow stage.For example, if the determined workflow stage corresponds to processinga software update, a computing resource 130 corresponding to a storagedevice that holds the software update may be required. At block 306, theserver computing device 106 may request access to the computing resource130 from a corresponding resource control device 110. One illustrativeroutine by which a resource control device 110 may manage requests for acomputing resource 130 will be described in more detail with referenceto FIG. 4, below.

At block 308, the server computing device 106 may receive an indicationas to the availability of the computing resource 130. As describedabove, in some instances, the server computing device 106 may notreceive such an indication. In some such embodiments, the servercomputing device 106 may be configured to retransmit an access requestto the resource control device 110, or to repeatedly retransmit anaccess request for a specified number of times. Illustratively, when anindication as to the availability of the computing resource 130 is notreceived from the resource control device 110 within a specified periodof time, the server computing device 106 may be configured to retransmitthe access request some n number of times. In other embodiments, theserver computing device 106 may be configured to request access to thecomputing resource 130 from a proxy control device 120, as describedabove with respect to FIG. 2B.

After a response is received as to the availability of the computingresource 130, if the computing resource 130 is determined not to beavailable, the server computing device 106 may pause the workflowprocess at block 310. As described above, pausing the workflow processmay include taking responsive actions, such as reducing functionality ofthe server computing device 106, or repeatedly transmitting a statusindicator to the resource control device 110. Further, in someembodiments, in addition to an indication that the computing resource130 is not available, the server computing device 106 may receiveinstructions to enter a specified state. In such embodiments, the servercomputing device 106 may execute instructions to enter the specifiedstate at block 310.

Thereafter, at the point at which the computing resource 130 becomesavailable to the server computing device 106, the server computingdevice 106 may continue processing the workflow at block 306. In someembodiments, the server computing device 106 may be configured torepeatedly request access to the computing resource 130 at block 306. Inother embodiments, a resource control device 110 corresponding to thecomputing resource 130 may inform the server computing device 106 thatthe computing resource 130 has become available. In such embodiments,the server computing device 106 may continue at block 312.

At block 312, after it is determined that the computing resource device130 is available, the server computing device 106 may process theworkflow stage. For example, where the workflow stage involves receivinga software update from a storage location, the server computing device106 may transfer an update file from the computing resource 130.Thereafter, the server computing device 106 may determine whether theworkflow process is completed. If the process is not complete, theserver computing device 106 may iterate to the next workflow stage atblock 316, and repeat the routine from block 304. If the process iscomplete, the routine 300 may end at block 318.

As described above, in some embodiments, the server computing device 106may not be aware of the overall workflow. In such embodiments, oncompletion of a workflow stage at 312, the server computing device 106may request the next workflow stage from the workflow control device 102or a resource control device 110. If no workflow stages remain, theworkflow control device 102 or the resource control device 110 mayreturn an indication that the workflow is complete.

With reference now to FIG. 4, an illustrative flow-diagram depicting aroutine 400 for managing resource-dependent workflows is depicted. Thisroutine may be carried out by, for example, a resource control device110 of FIG. 1. At block 402, the resource control device 110 receives aresource request corresponding to a computing resource 130 from a servercomputing device 106.

At block 404, the resource control device 110 may determine theavailability or expected availability of the computing resource 130.Illustratively, availability of a computing resource 130 may correspondto a measurement of one or more performance metrics of the computingresource 130. For example, such metrics may correspond to availablenetwork or other bandwidth of the computing resource 130, to availableprocessing power, persistent or transient memory of the computingresource 130, or power consumption of the computing resource 130. Insome embodiments, a performance metric may correspond to the responsetime of a computing resource 130. In still more embodiments,availability of a computing resource 130 may be determined at least inpart based on the number of server computing devices 106 accessing thecomputing resource 130. For example, a maximum number of servercomputing devices 106 that may simultaneously access a computingresource 130 may be specified. In these embodiments, the resourcecontrol device 110 may modify this maximum number of server computingdevices 106 based on other determinations of availability. For example,if the computing resource 130 is being accessed by the specified maximumnumber of server computing devices, but otherwise has a highavailability, the resource control device may increase this maximumnumber of server computing devices 106. Conversely, when a lower numberof server computing devices 106 are accessing a computing resource 130,but availability metrics drop, the resource control device 110 maydecrease this maximum specified number.

As described above, in some embodiments, historical information as tothe availability of computing resources 130 may be recorded. In theseembodiments, such historical information may be used to determine anavailable of a computing resource 130. For example, the resource controldevice 110 may utilize such history to determine the previousavailability of the same or similar computing resource 130 underconditions similar to any current operating conditions. In someembodiments, such historical data may be used to check a determinedavailability of a computing resource 130. For example, where thecomputing resource 130 has been determined to be available for use by aserver computing device 130, but similar historical situations reflectthat making the computing resource 130 available to the server computingdevice would result in instability, the computing resource 130 may bedetermined to be unavailable.

Optionally, at block 406, the resource control device 110 may recordinformation corresponding to the received request and to the determinedavailability. As described above, this information may be subsequentlyutilized by the resource control device 110 or another resource controldevice 110 in order to determine the availability or future availabilityof a computing resource 130. Still further, such historical data may beused to determine potential faults in one or more computing resources130. For example, historical data may indicate that the computingresource 130 should have a certain predicted level of availability.However, in practice, the computing resource 130 may not reach thepredicted level of availability. Such disparity may indicate an issuewith the computing resource 130.

Though described herein with reference to the resource control device110, in some embodiments, a separate computing device may recordhistorical computing resource access data. In some embodiments, such aseparate computing device may further determine the availability of acomputing resource based on that availability.

At block 408, if the requested computing resource 130 is determined notto be available, the resource control device 110 may transmit a commandto the requesting server computing device 106, such as a pause commandor a command to halt a workflow stage. As described above, in someembodiments, such a command may include responsive actions that a servercomputing device 106 should execute. In other embodiments, such acommand may include a state that the server computing device 106 shouldenter into.

Illustratively, a resource control device 110 may determine such a stateor responsive actions based on the determined availability of thecomputing resource 130, the expected resource usage by the servercomputing device 106, or other factors. For example, where a computingresource 130 is unavailable, but expected to be available in the nearfuture, the resource control device 110 may instruct the servercomputing device 106 to remain fully functional, and to transmit statusindicators requesting access to the computing resource 130. Where acomputing resource 130 is unavailable and expected to be unavailable formore than a certain period of time, the resource control device 110 mayinstruct the server computing device 106 to reduce or disable someamount of functionality in order to save computing power. This maycorrespond to instructing the server computing device 106 to ending a“parked” state. When a computing resource 130 is unavailable andexpected to be unavailable for an extending period of time, the resourcecontrol device 110 may instruct the server computing device 106 to powerdown, which may correspond to entering a “dormant” state.

In some embodiments, after a command to halt a workflow process is sent,the resource control device 110 may continually monitor the availabilityof the computing resource 130 at block 404. In other embodiments, theresource control device 110 may instruct the server computing device 106to request access to the computing resource 130 at some point in thefuture, and may not monitor an availability of the computing resource130. In some such embodiments, the routine 400 may therefore end.

If, at block 408, the computing resource 130 is determined to beavailable to the server computing device 106, the resource controldevice 110 may, at block 412 transmit a command to the server computingdevice 106 that access to the computing resource 130 is granted. Such acommand may correspond to placing the server computing device 106 in a“running” state. Thereafter, the server computing device 106 may processthe workflow stage as described above with reference to FIG. 3, and theroutine 400 may end at block 414.

In some embodiments, a resource control device 110 may, subsequent toprocessing a routine such as routine 400, continue to monitor acomputing resource 130 in order to determine the computing resource130's future availability or to modify the resource control devices 110information regarding that availability. For example, in someembodiments, availability to a computing resource may be limited to aspecified threshold number of server computing devices 106 that mayaccess a computing resource 130 at any given point. In theseembodiments, a resource control device 110 may monitor otheravailability metrics of a computing resource 130, such as availableprocessing power, bandwidth, or memory in order to determine whetherthat threshold number of accessing server computing devices 106 shouldbe modified. Still further, a resource control device 110 may monitorthe number or percentage of successful interactions with the computingresource, the amount of data loss when communicating with the computingresource 130, or any other metric that may determine the availability ofthe computing resource 130 to facilitate additional server computingdevices 106. Illustratively, if a computing resource 130 is beingaccessed by the specified maximum number of server computing devices106, but has the ability to service at least one additional servercomputing device 106, the resource control device 110 may increase thespecified maximum number of simultaneous accessing server computingdevices 106. Alternatively, if a computing resource 130 is beingaccessed by less than the maximum number of server computing devices106, but is low on an availability metric (e.g., available bandwidth,processing power, memory or storage), the maximum number of accessingserver computing devices 106 may be lowered.

FIG. 5 is a block diagram illustrating an embodiment of a multipleworkflow group environment. Illustratively, such an environment mayinclude multiple workflow groups, such as workflow groups 500A-C. Eachworkflow group may correspond, for example, to a workflow group 100 ofFIG. 1. As such, each workflow group may include one or more workflowcontrol devices 502A, resource control devices 510 (corresponding toresource control devices 110 of FIG. 1), proxy control devices 520(corresponding to resource control devices 120 of FIG. 1), computingresources 530 (corresponding to computing resources 130 of FIG. 1), andserver computing devices 506 (corresponding to computing resources 506of FIG. 1). These workflow groups 500 may be in communication via anetwork 504. In some embodiments, each workflow group 500 may correspondto a specific region or location, such as a city, state, country, orcontinent. In other embodiments, workflow groups may be separated byother physical or logical attributes. Though depicted herein as threeworkflow groups 500, any number of workflow groups may be incommunication and form a multiple workflow group environment.

Communication of workflow groups may be beneficial in order to allowserver computing devices 506 from a first workflow group, such asworkflow group 500A, to communicate with resource control devices 510and computing resources 530 from other workflow groups, such as resourcecontrol devices 510B and computing resources 530B of workflow group520B. Illustratively, when a computing resource 530A becomes overloaded,server computing devices 506A may request access to computing resources530B of workflow group 500B. As such, multiple workflow groups may worktogether to supplement overloaded computing resources 530.

Multiple workflow groups 500 may work together through a variety ofmechanisms. For example, in some embodiments, server computing devices506 from a first workflow group may be configured to automaticallycontact resource control devices 510 from another workflow group whenthey are unable to access a computing resource. In other embodiments,resource control devices 510 or proxy control devices 520 may beconfigured to redirect requests to another available workflow group whena computing resource 130 becomes over utilized. In still moreembodiments, resource control devices 510 from various workflow groups500 may be in communication to coordinate and determine mitigatingactions when computing resources 530 are overloaded. For example,resource control devices 510 from various workflow groups 500 mayassociate into a “council” of resource control devices 510. Thesecouncils may be formed by all resource control devices 510, or by onlyresource control devices 510 which correspond to similar computingresources 530. Such councils may use distributed decision makingtechniques in order to overcome issues of overloaded computing resources530. Examples of such distributed decision making techniques will bediscussed in more detail with reference to FIG. 6, below.

In some embodiments, the workflow groups 500 may be in communicationwith a workflow group oversight device 550. Such a workflow groupoversight device 550 may enable human oversight of mitigating decisionsmade by resource control devices 510. In this manner, a human overseermay be able to accept or reject these mitigating decisions. Further, aworkflow group oversight device 550 may enable a human overseer topropose mitigating decisions to resource control devices 510, or toimpose mitigating actions manually.

With reference now to FIG. 6, an illustrative flow-diagram depicting aroutine 600 for managing a multiple a multiple workflow groupenvironment is depicted. This routine may be carried out, for example,by one or more a resource control devices 510 of FIG. 5. At step 602, aresource control device 510 may determine that corresponding computingresource 530 is overloaded, exhausted, or otherwise unavailable, or ispotentially in danger of becoming unavailable. Such unavailability mayoccur, for example, during period of peak use of the workflow group 500including the computing resource 530, because of a failure in one ormore devices of the workflow group 500, because of a power outage ornatural disaster occurring near workflow group 500, or for variousadditional or alternative reasons.

Thereafter, at block 604, the resource control device 530 may determineavailability of similar computing resources 530 from other distinctworkflow groups 500. For example, in some embodiments, a resourcecontrol device 510 may be configured to directly inspect or querycomputing resources 530 from other workflow groups 500. In otherembodiments, a resource control device 510 may be configured to queryother resource control devices 510 which correspond to the similarcomputing resources 530 in order to determine their availability.

Based on the availability of similar computing resources 530, theresource control device 510 may at block 606 determine a mitigatingaction. In some instances, where similar computing resources areunavailable, or near their limit of availability, no mitigating actionmay be available. In such instances, the routine 600 may be configuredto notify a human operator, such as by transmitting a notification to aworkflow group oversight device 550. In other instances, the resourcecontrol device 510 may determine that some requests for a specificcomputing resource 530 of a first workflow group 500 could be redirectedto similar computing resources 530 of a distinct workflow group 500.

As described above, in some embodiments, a resource control device 510may be configured to determine such mitigating actions withoutinteraction with other resource control devices 510. In otherembodiments, multiple resource control devices 510 may interact tocollectively determine a mitigating action. Such collectivedetermination may use any of a variety of distributed decision makingtechniques and algorithms. For example, resource control devices 510from various workflow groups 500 may associate into a “council” ofresource control devices 510. These councils may be formed by allresource control devices 510, or by only resource control devices 510which correspond to similar computing resources 530. Such councils mayuse distributed decision making techniques in order to overcome issuesof overloaded computing resources 530. For example, a council may becomposed of a resource control device 510A, 510B, and 510C of FIG. 5.The resource control device 510A of workflow group 500A may determinethat a computing resource 530A is overloaded, unavailable, or predictedto become overloaded or unavailable in the future. The resource controldevice 510A may propose to such a council of resource control devices510 that a certain amount of requests for the computing resource 530A beredirected to computing resource 530B or 530C. Resource control device510B and 510C may determine their availability of correspondingcomputing resources 530B and 530C and collectively agree to or rejectsuch a proposal. In some instances, computing resources 530B and 530Cmay also be overloaded, or in danger of becoming overloaded. As such,the resource control devices 510 may collectively decide thatredirection of access requests from group 500A to groups 500B or 500Cshould not be allowed, since corresponding computing resources 530 arenot available.

In some embodiments, decisions of one or multiple resource controldevice 510 may have continuing future effect. Illustratively, in theexample above, where resource control device 510A is requesting accessto computing resources 530B and 530C, a decision to not allow suchaccess may be effective for a set duration of time. For instance,requests from resource control device 510A to access computing resources530B and 530C may be automatically denied for some specified period oftime. In some embodiments, resource control devices 510 may beconfigured to prevent transmission of such access requests during thespecified period of time. Such prevention may, for example, reduce theoverall number of group access requests in situations where a largenumber of computing resources 530 are overloaded or in danger ofbecoming overloaded.

At block 606, if a mitigating action has been determined, the mitigationaction may optionally be proposed to an oversight device, such asworkflow group oversight device 550 of FIG. 5. As described above, sucha workflow group oversight device 550 may be configured to accept orreject mitigating action proposals based on the input of a humanoperator. If the workflow group oversight device 550 approves themitigating action, the routine may continue at block 610. Otherwise, theroutine may end at block 612.

At block 610, the determined mitigation action is enforced by theresource control devices 510. For example, requests from servercomputing devices 506 from a first workflow group 500 to accesscomputing resources 530 from a first workflow group 500 may beredirected to corresponding resource control devices 510 of a secondworkflow group 510. After a mitigating action has been enforced, theroutine 600 may end at block 612.

It will be appreciated by those skilled in the art and others that allof the functions described in this disclosure may be embodied insoftware executed by one or more processors of the disclosed componentsand mobile communication devices. The software may be persistentlystored in any type of non-volatile storage.

Conditional language, such as, among others, “can,” “could,” “might,” or“may,” unless specifically stated otherwise, or otherwise understoodwithin the context as used, is generally intended to convey that certainembodiments include, while other embodiments do not include, certainfeatures, elements, and/or steps. Thus, such conditional language is notgenerally intended to imply that features, elements and/or steps are inany way required for one or more embodiments or that one or moreembodiments necessarily include logic for deciding, with or without userinput or prompting, whether these features, elements and/or steps areincluded or are to be performed in any particular embodiment.

Any process descriptions, elements, or blocks in the flow diagramsdescribed herein and/or depicted in the attached figures should beunderstood as potentially representing modules, segments, or portions ofcode which include one or more executable instructions for implementingspecific logical functions or steps in the process. Alternateimplementations are included within the scope of the embodimentsdescribed herein in which elements or functions may be deleted, executedout of order from that shown or discussed, including substantiallyconcurrently or in reverse order, depending on the functionalityinvolved, as would be understood by those skilled in the art. It willfurther be appreciated that the data and/or components described abovemay be stored on a computer-readable medium and loaded into memory ofthe computing device using a drive mechanism associated with a computerreadable storing the computer executable components such as a CD-ROM,DVD-ROM, or network interface further, the component and/or data can beincluded in a single device or distributed in any manner. Accordingly,general purpose computing devices may be configured to implement theprocesses, algorithms, and methodology of the present disclosure withthe processing and/or execution of the various data and/or componentsdescribed above.

It should be emphasized that many variations and modifications may bemade to the above-described embodiments, the elements of which are to beunderstood as being among other acceptable examples. All suchmodifications and variations are intended to be included herein withinthe scope of this disclosure and protected by the following claims.

What is claimed is:
 1. A computer-implemented method for implementing aresource dependent workflow, the method comprising: receiving, from aworkflow controller computing device, a workflow comprising a pluralityof workflow stages, each of the plurality of workflow stages associatedwith access to at least one computing resource; and for each of theplurality of workflow stages: determining the at least one computingresource associated with the workflow stage; requesting, from a resourcecontrol computing device associated with the at least one computingresource, access to the at least one computing resource; receiving anindication of whether the at least one computing resource is available,wherein the indication of availability of the at least one computingresource is determined by the resource control computing device inaccordance with an allocation of the implementation of the workflowstage by a plurality of computing devices; if the at least one computingresource is indicated to be available, processing the workflow stage atleast in part by accessing the at least one computing resource; and ifthe at least one computing resource is indicated not to be available, atleast temporarily pausing processing of the workflow stage.
 2. Thecomputer-implemented method of claim 1, wherein at least temporarilypausing processing of the workflow stage comprises executing at leastone responsive action.
 3. The computer-implemented method of claim 2,wherein the at least one responsive action comprises repeatedlytransmitting a signal indicating that the processing of the workflowstage has been at least temporarily paused.
 4. The computer-implementedmethod of claim 2, wherein the at least one responsive action comprisesreducing resource usage of a computing device implementing the method.5. The computer-implemented method of claim 2, wherein the at least oneresponsive action comprises powering down a computing deviceimplementing the method.
 6. The computer-implemented method of claim 1,wherein at least temporarily pausing processing of the workflow stagecomprises entering a defined state.
 7. The computer-implemented methodof claim 6, wherein the defined state is indicated by the resourcecontrol computing device.
 8. The computer-implemented method of claim 6,wherein the defined state is corresponds to at least one of pending,parking, or dormant.
 9. A computer-implemented method for managingresource dependent workflows, the method comprising: receiving, from acomputing device, a request to access a computing resource associatedwith at least one workflow stage; determining a level of availability ofthe computing resource, wherein the level of availability of thecomputing resource is determined in accordance with an allocation of theimplementation of the at least one workflow stage by a plurality ofcomputing devices; if the determined level of availability is above athreshold level, transmitting to the computing device an indication thataccess to the computing resource is granted; and if the determined levelof availability of the computing resource is below the threshold level,transmitting to the computing device an indication that access to thecomputing resource is not granted and instructions to at leasttemporarily pause the workflow stage.
 10. The computer-implementedmethod of claim 9, wherein the received request is received via a proxycontroller computing device.
 11. The computer-implemented method ofclaim 9, wherein determining a level of availability of the computingresource includes determining a number of distinct computing devicesthat have requested access to the computing resource.
 12. Thecomputer-implemented method of claim 9, wherein transmitting to thecomputing device an indication that access to the computing resource isgranted may only occur if the number of computing devices accessing thecomputing resources is below a maximum number of computing devices thatmay access the computing resource, and wherein the method furthercomprises, subsequent to transmitting to the computing device anindication that access to the computing resource is granted: determiningan updated level of availability of the computing resource; if thedetermined updated level of availability is above the threshold level,increasing the maximum number of computing devices that may access thecomputing resource.
 13. The computer-implemented method of claim 9further comprising, if the determined level of availability of thecomputing resource is below the threshold level: determining an updatedlevel of availability of the computing resource, wherein the updatedavailability of the computing resource is determined in accordance withan allocation of the implementation of the at least one workflow stageby a plurality of computing devices, and wherein the updated level ofavailability of the computing resource is above the threshold level; andtransmitting to the computing device an indication that access to thecomputing resource is granted.
 14. A system for implementing a resourcedependent workflow, the system comprising: a computing device incommunication with a workflow controller device, the computing deviceconfigured to: receive, from the workflow controller computing device, aworkflow comprising at least one workflow stage, each of the at leastone workflow stages associated with access at least one computingresource; and for each of the at least one workflow stages: determinethe at least one computing resource associated with the workflow stage;request, from a resource control computing device associated with the atleast one computing resource, access to the at least one computingresource; receive an indication of whether the at least one computingresource is available, wherein the indication of availability of the atleast one computing resource is determined in accordance with anallocation of the implementation of the workflow stage by a plurality ofcomputing devices; if the at least one computing resource is indicatedto be available, process the workflow stage at least in part byaccessing the at least one computing resource; and if the at least onecomputing resource is indicated not to be available, pause processing ofthe workflow stage at least temporarily.
 15. The system of claim 14,wherein the computing device further is configured to: if the resourcecontrol computing device associated with the at least one computingresource is unavailable, request access to the at least one computingresource from a proxy controller computing device associated with theresource control computing device.
 16. The system of claim 15, whereinthe proxy controller computing device is configured to forward theaccess request to the resource control computing device.
 17. The systemof claim 14, the at least on resource controller further configured to,subsequent to processing the workflow stage, receive an instruction toprocess a next workflow stage.
 18. The system of claim 14, wherein atleast temporarily pausing the workflow stage comprises executing atleast one responsive action.
 19. The system of claim 14, wherein atleast temporarily pausing processing of the workflow stage comprisesentering a defined state.
 20. The system of claim 14, wherein thecomputing device is further configured to: subsequent to receiving anindication that the at least one computing resource is not available,receive an indication that the at least one computing resource isavailable; and process the workflow stage at least in part by accessingthe at least one computing resource.
 21. A system for managing resourcedependent workflows, the system comprising: at least one resourcecontrol device associated with at least one computing resource, whereinthe at least one resource control device is in communication with acomputing device, and wherein the at least one resource control deviceis configured to: receive, from the computing device, a request toaccess the at least one computing resource, wherein the request isreceived in conjunction with the computing device processing a workflowstage; determine an availability of the at least one computing resource,wherein the availability of the at least one computing resource isdetermined in accordance with an allocation of the implementation of theworkflow stage by a plurality of computing devices; if the determinedavailability is above a threshold level, grant access to the at leastone computing resource to the computing device; and if the determinedavailability of the computing resource is below the threshold level,transmit to the computing device instructions to at least temporarilypause the workflow stage.
 22. The system of claim 21, wherein the atleast one resource control device is further configured to determine anumber of distinct computing devices that are predicted to requestaccess to the computing resource.
 23. The system of claim 21, whereinthe at least one resource control device is further configured todetermine an availability of at least one of bandwidth, processingpower, electrical power, non-persistent memory or persistent memory ofthe computing resource.
 24. The system of claim 21, wherein the at leastone resource control device is further configured to determine a futurepredicted availability of at least one of bandwidth, processing power,electrical power, non-persistent memory or persistent memory of thecomputing resource.
 25. The system of claim 21, wherein the instructionsto at least temporarily pause the workflow stage comprise instructionsto execute at least one responsive action.